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Abstract 

We consider the problem of reconstructing Jacobi matrices and real 
symmetric arrow matrices from two eigenpairs. Algorithms for solving 
these inverse problems are presented. We show that there are reasonable 
conditions under which this reconstruction is always possible. Moreover, 
it is seen that in certain cases reconstruction can proceed with little or 
no cancellation. The algorithm is particularly elegant for the tridiagonal 
matrix associated with a bidiagonal singular value decomposition. 
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1 Jacobi matrices 

Let T be an unreduced real symmetric tridiagonal matrix (i.e. a Jacobi 
matrix) 



Oi 0 \ 

0 \ 02 02 



T = 



02 



0n - 1 



Pn- 

O n 



0 ) 



with 0 X > 0 for i = 1,2, ...,n — 1. We use the notation introduced in 
[ll] and let UST(n) denote the set of n x n real unreduced symmetric 
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tridiagonaJ matrices, and let UST+(u) denote that subset of UST(n) 
with positive fi t . 

We wish to develop an algorithm to reconstruct T from the knowledge 
of two of its eigenpairs (A, u) and (/*,v). The eigenvector recurrence for 
symmetric tridiagonal matrices is 

/J.-iti.-i -f o,u, + = A u, (2) 

where (A, u) is any eigenpair of T, u, is the ith element of u, and 0o = 
0 n = 0. Applying this relation to both eigenpairs gives 



-f Q»u, T + i = An, 

r,_i + o«r, + ftr.+ i = fiv t . 

Combining these two equations and eliminating o, gives 



0 t -i(v l u t -i - ti, t»,_i ) 4* - t’.+ ju,) = (A - fi)u t v t . (3) 

Since /? 0 = 0 n = 0 we get the following initial and terminal conditions 

/?i(ti 2 fi - t* 2 ui) = (A-ziJujtq (4) 

- u n u n _i ) = (A — n)u n v n . (5) 

Combining (3) with (4) gives a special case of the Christoffel-Darboux 
identity, 

t 

A(u,+ ii'. - tq+iu,) = (A - /j)^ t ikv k (6) 

fc = i 

for i = 1,2 n — 1. There is also a backward formula, 

n 

- tq+iti,) = -(A — /i) ^ U k V k , (7) 

*> = »+ 1 

which follow's from (3) and (5), or from (6) and the orthogonality of the 
eigenvectors. In a similar manner, we can show that 



2a,u l v l = (A + /i )«,!», - 0 t -i (u,r,_i -f v t u t -\ ) - 1 v, + v»+i u,). (8) 

This formula uses all of the available information but it is possible to 
obtain an equation for the a, using the /?, and a single eigenpair with the 
formula 



a,i>, = - /?,!/,+]. (9) 

We can use these equations to reconstruct the original matrix from the 
two eigenpairs provided that no element of the two eigenvectors is zero 
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n — 1. If this is true, then 



and that r,u, 4 i — ii,r, 4 i ^ 0 for any i = 1 , 2, 
the equations for the a, simplify to 



2a, = (A + /i) - /?, — i 



(— — ■ + — — (^ + 
\ Vi U, / \ V, 




or 



(10) 



a, = A - /?,. 



u.-i 

u, 






n«4 1 

u. 



( 11 ) 



Notice that (lu) is just the simple average of (11) over both eigenpairs. 
Using (11), (0), and (7) we can reconstruct the original matrix in 13 ?j — 9 
flops. 

In order to determine when these formulas can be applied, we need 
some additional results. We introduce the following fact from [ 1 0] . 



Fact 1 Let T E UST 4 (n) and assume that the eigenvalues are ordered 
so that Ai > A 2 > ... > A„. Then the number of sign changes between 
consecutive elements of the kth eigenvector of T, denoted Sk, is k — 1. 



We refer the reader to [10] for a proof but note that it can be derived 
from the Sturm sequence property for the characteristic polynomials of the 
principal submatrices. With this fact in hand we can prove the following 
theorem. 



Theorem 1 // T 6 UST 4 (?i) and if (A,u) and (/i,v) are the extremal 
eigenpairs of T, that is A = Aj and p = A n , then t\u, 4 i — u,r, 4 i ^ 0 for 
any 1 = 1 , 2, ?i — 1 . 

Proof. The proof follows trivially b : noting that the strict interlacing 
property for unreduced symmetric tridiagonals (see [12] p. 300) guaran- 
tees that none of the numbers u, , u, 4 1 , v, , r, 4 i can be zero. And, since u, 
and u, 4 i must have the same sign and v t and v, 4 i must have opposite 
signs (from fact 1), it follows that both terms in ti,t’ l4 i — t* t u l4 j have 
opposite signs and are nonzero so this difference is really a sum of two 
strictly positive (negative) numbers and hence is not zero. □ 

Hence, if we choose the two extremal eigenpairs of a given element of 
UST 4 we can always reconstruct the original matrix using the formulas 
above. Notice that the denominator is computed without cancellation in 
this case because of the sign pattern. Moreover, if we use the smallest 
(largest) eigenpair in (9) to get the a,, then these can be reconstructed 
from the derived fi x and the data without further cancellation if the matrix 
is positive (negative) definite. If the matrix is indefinite then there is only 
one additional cancellation for each of the a,. If the matrix is singular 
then choosing the eigenvector associated with the zero eigenvalue prevents 
further cancellation. 

Note that any element of UST(n) has exactly 2n — 1 real degrees of 
freedom and that two eigenpairs contain 2n + 2 numbers but, in fact, also 
have 2 n — 1 real degrees of freedom since there are two arbitrary scaling 
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parameters for the eigenvectors and a single orthogonality condition. The 
eigenpairs contain precisely the right amount of information. 

This algorithm is especially robust when applied to the tridiagonal 
matrix associated with the bidiagonal SVD. It is well known [7] that the 
Jordan-Lanczos matrix 



0 b t 

B 0 



( 12 ) 



where B G 9\ nXT ‘ is an unreduced bidiagonal with positive elements, can 
be reduced via the perfect shuffle to an unreduced tridiagonal T of the 
form 



' 0 

0 0 2 



0n- 1 
0n~l 0 



(13) 



The matrix T is 2 n x 2 n and its eigenvalues occur in plus-minus pairs. 
It is not difficult to show that if (A. u) is an eigenpair of T then ( — A, 5u) 
is also an eigenpair where 5 is diagonal with 1 and —1 alternating as the 
diagonal elements. The reconstruction formula for this matrix simplifies 
considerably since we need only a single eigenpair. In particular, the 0, 
are given by 



0i = 5>1 * 1111.1 (14) 

k-\ 

As a special case of the more general algorithm it is obvious that the 
denominator i u t is not zero provided we use the eigenvector associated 
with the largest eigenvalue. Even more intriguing is that, provided none 
of the principal submatrices shares an eigenvalue with the full matrix, 
this denominator will be non-zero for any eigenpair since in this case no 
element of any eigenvector can be zero. In other words, the reconstruction 
from any eigenpair is well-posed provided that the given eigenvector has 
no zero elements. The algorithm requires 5n — 7 flops working with (14) 
and the backward equation 



A = ■ 1) + ' A (15) 

k=n 

Notice that this matrix has only n — 1 real degrees of freedom which 
is exactly what is given by one eigenpair since the eigenvector contains 
an arbitrary scaling parameter and must satisfy the special orthogonality 
condition 
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( 16 ) 



£Vl)V = 0. 

.= 1 

We point out that this algorithm can be interpreted as the reconstruc- 
tion of an unreduced bidiagonal B from its largest singular vaJue and both 
associated singular vectors. 



2 Arrow Matrices 

We can reconstruct the arrow matrix in a similar manner to that given 
above. The arrow is of some importance as it occurs in certain divide and 
conquer schemes for finding the eigenvalues of a tridiagonal matrix [l, 8]. 
The arrow is also an element of the class of symmetric acyclic matrices 
(as is the Jacobi matrix) and hence it is possible to find its eigenvalues 
with “tiny componentwise relative backward error", [5]. 

The general form of an arrow matrix is 



A = 






o 2 



L 0i 02 



Pi 

07 



a n -l fin — 1 
fin- 1 7 



0 ") 



\{ fit 0 for i = 1,2, ...,h — 1 and if q, ^ a } for any t ^ j then 
we shall say that A E USA(n), where U^/.'n) is the set of unreduced 
symmetric arrow matrices. Proceeding ;i before, we let (A,u) and (p, v) 
be two eigenpairs of A. The eigenvectoi recurrence is 



a,u, + 3 x u n = A u x (18) 

OtVt + fitVn = Pl't (19) 

for t = l,2,...,n — 1. Moreover, the eigenvector relation also gives 



7 = P “ 




( 20 ) 



for any eigenpair (p,v) of A. If we combine (18) and (19) and eliminate 
q, we get 



fit(v t U n - U t Vrx) = (A - fi)u t V t . 


(21) 


Similarly, eliminating fi x gives 




Qt(i\u n - u,u n ) = fiVtUrr. - \u t v n . 


(22) 


This gives a very simple, easily vectorizable reconstruction algorithm. 
The only remaining question is whether the quantities u n u, — u n v t are all 
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nonzero. In order to show that this is true under the correct conditions, we 
need to first establish some facts about the eigenvectors of an unreduced 
arrow matrix. We begin by noting that 



A- XI = 



D -XI b 
b T 7 - A 



( 23 ) 



where D = diag(ai,Q2,...,a n -i), and b = [/?i , /?2, ■■■, Pn-}] T ■ Following 
[8] we compute the Gauss factorization 



b 

1 

c r 




/ 0 ' 




' D-XI b 


c r 

s 

1 




h T (D-\l)~' 1 




— 1 

1 

k 

0 



( 24 ) 

where /, the spectral Junction , is given by 

/( A) = A-7 + £^Ta- ( 25 ) 

1 =] 

From ( 24 ) and ( 25 ) the zeros of / are the eigenvalues of A. Further- 
more, if A is unreduced, then the eigenvalues of A are strictly interlaced 
by the a,. It follows that the eigenvector associated with X is 



v(A) = 



(XI - D)~' b 

1 



( 26 ) 



Note that distinctness of the a, is critical since it guarantees that (XI — D ) 
is nonsingular. Combining this description of the eigenvectors with the 
fact that the a, interlace the eigenvalues, we have the following fact 



Fact 2 Let A be an unreduced arrow matrix with > 0 for i = 1, 2 , n — 
1 . Then the following hold. 



1 . If u is any eigenvector of A then ii, ^ 0 for any i = l, 2 ,...,n. 

2 . If we order the eigenvalues of A so that Ai > A2 > ••• > A n and 
let u k be the eigenvector, from ( 26 ), associated with A*, then the 
first k — 1 elements of u* are less than zero , and the last n — A; + 1 
elements are greater than zero. 

Proof. The proof of the first fact follows directly from formula ( 26 ) 
and the interlacing property. The second fact follows from formula ( 26 ), 
the interlacing property, and the positivity of the /?,. □ 

This simplifies the reconstruction formula since, if we assume that the 
eigenvectors are normalized so that their last elements are equal to one, 
the reconstruction formulas can be rewritten as 



Q t 



A _ Uj - A ) t, » 

U, — V, 



6 



0 . 



(// - A )u,r, 



( 27 ) 



1 



u, — r, 



z — ' U, — t', 



Using these formulas, we can reconstruct the arrow matrix in lOn — 8 
flops. Under the previoush mentioned conditions, it is easily shown that 
none of the denominators in the reconstruction formula are zero and hence 
we can always reconstruct the matrix from two eigenpairs. 

Theorem 2 If A ts an unreduced arrow matrix, and if A and g arc any 
two dtstmct eigenvalues of A with associated eigenvectors u and v , nor- 
mahzed to have their last elements equal to one, then «, — v, ^ 0 for 

i = 1 , 2 , - 1 

Proof Assume that u, = v t . The eigenvector relation implies that 



u, 


1 




Q, 




‘ An, 


V , 


1 




. * . 




/ir, 



which implies that A = /i, but this contradicts the distinctness of the 
eigenvalues. Hence, it follows that u, / r,. □ 

The reconstruction algorithm has another very important property: if 
the two extremal eigenpairs (Aj and A n and their associated eigenvectors) 
are used, then the /?, can be found, up to the scaling factor A] — A n , 
without cancellation. This follows from the fact that if the corresponding 
eigenvectors are normalized so that their last elements are both one, then 
all the remaining elements must have opposite signs. This is fortuitous 
since it means that the differences that appear in the denominator do not 
involve cancellation. Moreover, if A is indefinite there are no cancellations 
whatsoever in computing the Q x . Conversely, if A is definite there are no 
cancellations in computing the o,. If A is semi-definite (and singular) 
then there is no cancellation at all, including the computation of 7. The 
computation of 7 involves one cancellation if the matrix is indefinite, and 
none if it is definite, or semi-definite, provided we choose the correct eigen- 
vector for its computation. In any case, whenever there is cancellation in 
this algorithm, it is benign. 



3 Breakdown of the Jacobi reconstruc- 
tion 

On seeing that the reconstruction algorithm for the arrow is well posed 
for any two eigenpairs, it is tempting to believe that this might also be 
the case for the Jacobi matrix algorithm since the same conditions apply 
- unreduced, no principal submatrix shares an eigenvalue with the full 
matrix. Unfortunately, it is not true. Consider the matrix 
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( 29 ) 



" 6 2 0 0 “ 

2 4 5 0 

0 5 4 2 

_ 0 0 2 6 _ 

which is an element of UST+ and satisfies the condition that no principal 
submatrix shares an eigenvalue wdth the full matrix. The eigenvalues of 
this matrix are 10, (5 + V / 65)/2, 5, (5 — \/65 )/2 and the eigenvectors 
associated with 10 and 5 are [12 2 l] T and [—2 1 1 — 2] T , respectively. 
Note that the reconstruction algorithm breaks down for these two eigen- 
pairs and cannot uniquely determine 02. Some manipulation of the scalar 
equations shows that the two eigenpairs in question are eigenpairs of any 
matrix of the form 



' 6 2 0 O' 

2 9-7 7 0 

0 7 9-72 

0 0 2 6 



(30) 



Fortunately, we can say a few things about breakdown. First of all, 
if the algorithm breaks down in the computation of /?, then it cannot 
break down in the computation of 0 t -\ or /?, + i since this implies that 
two distinct eigenvalues share the same eigenvector. Second, if there is a 
breakdown then it is possible to reconstruct a parametrized matrix with 
the specified eigenpairs by setting 0, = 7 and solving for o, and 0,41 
in terms of 7 . Setting 7 = 0 will yield a reduced tridiagonal with the 
specified eigenpairs. 



4 Stabilizing divide and conquer algo- 
rithms 



We note that there are several other important inverse problems for the 
symmetric arrow matrix. Of interest, is the reconstruction of the sym- 
metric arrow from the eigenvalues and the shaft of the arrow (i.e. the 
elements o,). In this case it is also possible to reconstruct the arrow in 
a straightforward manner since we need only determine the 0, and the 
element 7 . Clearly, we can obtain 7 from the trace formula, that is 

n n — 1 

7 = (31) 

1=1 1=1 

The 0 t can be computed directly since the —0* are the residues of the 
partial fraction decomposition 



/( A) = 



ir g ,(*-*o 

ri.r/tA-a.) 




(32) 
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Thus we have 



0] = lim (a k - A)/(A) = - , (Qj *’} (33) 

This algorithm is used in [3] for the reconstruction of a periodic Jacobi 
matrix. It can also be applied to stabilize the extension based tridiagonal 
divide and conquer algorithms [l, 8]. 

We note that this is very similar with the inverse problem first con- 
sidered in [2] and then used in [9] to stabilize the modification based 
Cuppen-Dongarra-Sorensen algorithm [4, 6]. In particular, the zeros of 
the spectral function 



n 3 7 

/(A) = 1 + (34 J 

^ ' q, — A 

. = i 

are the eigenvalues of D + lib 7 The authors of [9] show that loss of 
orthogonality in computing the eigenvectors can be avoided by using the 
computed eigenvalues A, in the reconstruction formula 



& 



2 

J 



rr.A - °j) 
~ Q ;> 



(35) 



and then computing the eigenvectors of D -f bb from their explicit ex- 
pressions. The enlightened use of shifts of the origin [9] is crucial to both 
algorithms. 
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